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(54) Stereoscopic Imaging system 



(57) Avisual image system isconstructedas includ- 
ing: a three-dimensional visual Image reproduce r(1) for 
transmitting a three-dlrnensional video signal; a parallax 
quantftyi detecting section (2) for detecting a parallax 
quantity In tine three-dimensional video signal from the 
three-dimensional visual image reproducer (1); a fatigue 
measure estimating section (3) for estimating the de- 
gree of fatigue based on the detected parallax quantity 
and outputting an Image switching signal correspond- 
ingly to a fatigue measure estimating quantity: a 3D/2D 



image switching section (4) for providing an output by 
switching between three-dimensional and two-dimen- 
sional images based on the image swltchlng signal; and 
an image display section (5) for displaying a three-di- 
mensional image or a two-dimensional image. The. vls-^ 
ual image system thereby fulfills the capability of suita- 
bly conlrolllngthe degree of three-dimensionality of ster- 
eoscopic images by inferringfrom the inputted video sig- 
nal the degree of effects likely to be produced on the 
obsen/er. 
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Description 

[0001] The present invention relates to visual image 
systems and, more particularly, relates to a visual image 
system in which the degree of three-dimensionality is 
controlled by estimating effects produced on the observ- 
er based on video signals. 

[0002] Various proposals have been made with re- 
spect to visual Image systems. For example, the follow- 
ing technique Is disclosed In Japanese Patent Publica- 
tion No.2594235 as that tor converting two-dimensional 
visual Image Into three-dimensional visual image. In 
particular, a disclosure has been made with respect to 
a method for converting a two-dimensional visual image 
into a three-dimensional visual image in which the ex- 
tent and direction of a horizontkl mbtlbn in Image 1^ de- 
tected using a two-dimensional video signal by gener- 
ating from the two-dimensional video signal a main vid- 
eo signal sen/ingasa reference and a subordinate video 
signal delayed from the main video signal. The delay 
amount for generating subordinate video signal is then 
determined on the basis of an extent of motion and an 
image switching means tor inputting the main or subor- 
dinate video signal is regulated depending on the direc- 
tion of the motion, thereby providing an output with de- 
termining which one of the main or subordinate video 
signal is outputted as a left-eye video signal or a right- 
eye video signal. 

[0003] Further, the following technique is disclosed in 
Japanese patent application laid open N0.9^116928. In 
particular, a dieclosure hae been rm6e with respect to 
technique for converting a two<limensional visual im- 
age into a three-dimensional visual Image in which a first 
phase-shifted visual image of which horizontal phase is 
gradually delayed by each one field along a vertical di- 
rection is produced based on a two-dimensional Input 
Image and a second phase-shifted visual image of 
which horizontal phase is gradually advanced by each 
one field along the vertical direction is produced based 
on the input Image. One of the first phase-shifted and 
second phase-shifted images is used as a visual image 
for the left eye and the other is used for a visual image 
for the right eye. 

[0004] it is generally said that the eyes are more lil^ely 
to become fatigued when observing a stereoscopic im- 
age comparing to the case of obsen^ing an ordinary two- 
dimensional image. As a proposal considering this 
point, Japanese patent application laid open No. 
9-23451 discloses an apparatus for controlling stereo- 
scopic condition as follows. In particular, a disclosure 
has been made with respect to a controlling apparatus 
in which: a sensor for detecting the temperature of skin 
at the forehead and a sensor tor detecting the temper^ 
ature of skin at the nose are set on glasses for viewing 
stereoscopic images so that a measure of excitation Is 
provided from an excitation measure data converter 
based on their delected outputs; and a sensor for de- 
tecting bWnk Is set on the glasses for viewing stereo- 



scopic Images so that a measure of fatigue js provided 
based on its detected output. A measure of enhance- 
ment on three-dimensionality is then outputted from a 
stereoscopic enhancement controlling circuit based on 

s the degree of excitation and the degree o1 fatigue. The 
delay amount at a field memory of the stereoscopic tel- 
evision receiver for effecting 2D/3D conversion, is con- 
trolled depending on this stereoscopic enhancement 
measure, thereby making it possible to control to a ster- 

10 eoscopic condition which is desirable according to the 
user's sensitivity. 

[0006] In the case of controlling the degree of three- 
dlmenslonaiity of stereoscopic image based on the~de- 
gree of excitation and degree of fatigue of the user as 

75 in the method of the aboveHnentioned disclosure, how- 
ever, the biological measurements on the user vary 
greatly from one individual to another, making it difficult 
to determine from the biological nheasurertients a limit 
value of fatigue measure which is suitable to all the ob- 

20 servers. 

Furthermore, there is another problem that It is trouble- 
some to indfvidualiy obtain the nrieasurernents from 
each observer. 

[0006] To eliminate the above problems in the known 

25 apparatus for controlling the degree of three-dimension- 
ality of stereoscopic image, it is a main object of the 
present invention to provide a visual Image system in 
which the degree of effects likely to be produced on the 
observer is Inferred from inputted video signal without 

30 performing any biological measurement on the obsen^er 
and It Is thereby possible to suitably control a three-di- 
mensionality measure of stereoscopic Image. 
[0007] In accordance with the present Invention, there 
is provided a visual image system Including: influence 

36 measure estimating means for estimating from inputted 
vkJeo signal the degree of influence produced on an ob- 
server; and three-dimensionality controlling means for 
restraining the degree of three-dimensionality of stere- 
oscopic image to be presented to the obsen^er based 

40 on an Influence measure estimating quantity obtained 
at the influence measure estimating means. Further, in 
accordance with the invention, there is provided a visual 
image system including: influence measure estimating 
means for estimating from inputted video signal the de- 

45 gree of influence produced on an observer; and means 
for regulating switching of stereoscopic image to two- 
dimensional image based on an influence measure es- 
timating quantity obtained at the influence measure es- 
timating means. 

so [0008] The degree of Influence produced on the ob- 
server Is thus estimated from inputted video signal and, 
on the baslsof such influence measure estimating quan- 
tity, the degree of three-dimensionality of stereoscopic 
image is restrained or switching from stereoscopic im- 

55 age to two-dimensional image is regulated. It Is thereby 
possible to achieve a visual rnage system in which ster- 
eoscopic image can be suitably controlled 30 as not to 
produce such effects as fatigue on the observer without 
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any biological measurement on the observer. The abcwe 
main object Is thereby accomplished. 
[0009] It is another object of the present invention to 
provide a visual image system in which a suitable control 
on displaying method of visuar image such as switching s 
of stereoscopic image to two-dimensional image or re- 
straining of parallax quantity for the purpose of not pro- 
ducing such effects as fatigue on the observer can be 
effected also without any biological measurement on the 
observer. 

[001 0] In accordance with the present invention, there 
is provided a visual image system inotuding: influence 
measure estinnating means for estimating from Inputted 
video signal the degree of influence produced on an ob- 
server; and display controlling means for com rolling dis- 
playing method of visual image to be presented 1o the 
observer based on an influence measure estimating 
quantity obtained at the influence measure estimating 
means. ' ■ 

[001 1 ] The degree of influence produced on the ob- 
server is thus estimated from inputted video signal and 
the displaying method of visual image is controlled on 
the basis of such influence measure estimating quantity 
It Is thereby possible to achieve a visual image system 
In which a suitable control on displaying method of visual 
image such as switching of stereoscopic image to two- 
dimensional image or restraining of parallax quantity tor 
the purpose o1 not producing such effects as fatigue on 
the obsen^er can be effected also without any biological 
measurement on the observer. The above object Is 
thereby accomplished. 

[001 2] The Invention is descrbed further hereinafter, 
by way of example only, with reference lo the accompa- 
nying drawings, in whlch:- 

[0013] Fig.l is a schematic block diagram showing a 
first embodiment of the visual image system according 
to the present invention. 

[001 4] Figs.2A, 2B, 2C are illustrations tor explaining 
parallax quantity In a three-dimensional image. 
[0015] Fig.Sshows correspondence between conver- 
gence and accommodatbn and their allowable range 
explaining the relationship between parallax quantity 
and fatigue. 

[0016] Fig. 4 Is a flowchart for explaining an algorithm 
to be followed at the fatigue measure estimating section 
in the first embodiment shown in Fig.1 . 
[0017] Fig.5 is a block diagram showing a construc- 
tion of the fatigue estimating section in the first embod- 
iment shown In Fig. 1. 

[001 8] Fig.6 is a block diagram showing a second em- 
bodiment of the present invention. 
[0019] F)gs.7A, 7B, 7C, 7D illustrate an example of 
restraining the degree of three<limen6lonality in a ster- 
eoscopic image. 

[0020] Figs.BA, SB, 8C, 8D illustrate another example 
of restraining the degree of three-dimensionality In a 
stereoscopic image. 

[0021] Fig. 9 is a biock diagram showing a third em- 



bodiment of the present invention. 

[0022] Figs. 1 0A, 1 0B, IOC, 10D showthe mannerof- 

continuously varying parallax quantity in a stereoscopic 

image. 

[0023] Fig.1 1 is a block diagram showing a fourth em- 
bodiment of the present invention. - 
[0024] Figs. 12A, 128, 12C illustrate an example of 
detecting motion vectors in visual image. 
[0025] Fig.1 3 is aflowchart for explaining an algorithm 
to be followed at the fatigue estimating sectbn in the 
fourth embodiment shown in Fig:ll. ^ ^ - 
[0026] Fig;1 4 is a block diagram showing a construc- 
tion of the fatigue estimating, section in the fourth em- 
bodiment shown in Fig. 11. 

[0027] Fig. 15 is a block diagram showing a fifth em- 
bodiment of the present invention. 
[0028] Some embodiments will now be described. 
Flg.1 is a schematic block diagram showing a first em- 
bodiment of the visual image system according to the 
present invention. Referring to Fig.1 : what is denoted by 
numeral 1 is a three-dimensional image reproducer for 
transmitting three-dimensional video signal; 2, a paral- 
lax quantKy detecting section for detecting a parallax 
quantity in three-dimensional video signal outputted 
from the three-dimensional image reproducer 1 ; 3, a fa- 
tigue measure estimating section for estimating a fa- 
tigue measure based on the parallax quantity detected 
at the parallax quantity detecting section 2; 4, a 3Dy2D- 
image switching section for providing output by switch- 
ing between three-dimensional video signal and two-di- 
mensional video signal ln accordance with an image 
switching signal which is provided on the basis of the 
estimation of fatigue measure; 5, an image display sec- 
tion tor displaying a three-dimensional image or a two- 
dimensional image outputted by the image switching 
section 4. It should be noted that, in the figure, 3D image 
represents a three-dimensional image and 2D image 
represents a two-dimensional Image. 
[0029] A description will now be given by way of Figs. 
2A to 2C with respect to parallax quantity in a three-di- 
mensional video signal. Flg.2A shows the manner of ob- 
serving a three-dimensional (stereoscopic) image 
where asphere appears as jutting out, in which: denoted 
by numerals lla and lib are the left and right eyes, re- 
spectively; 1 2 is a lens disposed immediately in front of 
the left and right eyes; and 13a and 13b are a left-eye 
LCD visual image display section and a right-eye LCD 
visual image display section, respectively, located adja- 
cent to the lens 12^ on which the visual images shown 
in Figs.2Band 2C are displayed, respectively Referring 
to Flgs.2B, 2C, mark A represents an image at Infinity 
and mark O represents a sphere which is displayed 
three-dimensionally (in a jutting out manner). Here, XL. 
represents the horizontal position of the sphere in the 
left-eye image and XR represents the horizontal position 
of the sphere in the right-eye image, these being not 
equal to each other in value and shifted toward the right 
or toward the left from their median. 
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[0030] In Fig.2A. what is denoted by numeral 15 is a 
virtual image position at which the sphere viewed by the 
left and right eyes is displayed, the eyes being focused 
on this position. Denoted by numeral 14 is a fusion im- 
age position at.which the two images at the virtual image s 
position 15 are viewed as one image by the two eyes. 
Here, the distance from the position of lens l2:tothe 
fusion image position. 14 is referredto as a convergence 
distance and the distance from the position of lens 12 
to the virtual image position 1 5 is referred to as a visual io 
range. The parallax quantity, represented by the differ- 
ence In horizontal position between the left and right im- 
ages (XL-XB). Is in conformity with the eonvergence dis- 
tance so that a larger parallax quantity means a greater 
jutting out toward the observer. is 
[0031] A description will now be given with respect to 
the relationship between the parallax quantity and the . 
fatigue measure. A diagram as shown in Flg.3, indicat- 
ing a correspondence between convergence and ac- 
commodation and their allowable range, and a discio- 20 
sure of the following spirit can be found in a Japanese 
journal "Seiri-kogaku" (Kabushikigalsha Shin-gijutsu 
Communications, Dec.1985: pp. 103-1 05). The conver- 
gence ak>ng the axis of abscissa in Fig.3, corresponding 
to the convergence distance, is represented by conver- 
gence angle (MW) and the distance of its reciprocal On 
the other hand, the accommodation along the axis of 
ordinate, corresponding to the visual range, Is repre- 
sented by diopter "D". Referring to Fig.3, the 45-degr6e 
solid line at the center represents the portion of com- so 
plete correspondence between convergence and ac- 
commodation, the vicinity thereof indtoating a range 
whk^h is allowable for example due to depth of focus. 
The range somewhat varies depending on the adopted 
reference for altowance, I.e., visual acuity (e :6|i) or blur 35 
detectivity (6: 15|x). The curves on the outer sides repre- 
sent fusion image limit of the two eyes: the solid lines 
through black dots represent a maximum fusion image 
limit; the dotted tines represent the range in which a fu- 
sion image is established again from a condition of dou- 40 
b!e images; and the dashed lines represent a fusbn im- 
age limit when the image displaying time Is 0.5 sec. A 
disclosure is made therein that a feeling of exhaustion 
is caused by a prolonged observation of a dynamic im- 
age unless it is a stereoscopic reproduction within the 45 
dashed-line range. 

[0032] The present invention has been made based 
on these disclosures. A description wiil now be given by 
way of a flowchart in Ftg.4 with respect to an algorithm 
to be executed at the fatigue measure estimating sec- so 
tion in the embodiment shown in Fig.1. First, a parallax 
"p" is detected from the left and right three-dimensional 
video signals (step SI). A function value for estimating 
the fatigue measure is then cabulated based on the de- 
tected parallax "p" (step S2). Thislunction calculation Is ss 
performed by considering the influence (fatigue) pro- 
duced on the observer's eye by a parallax in the stere- 
oscopic image. For example, a measure of such influ- 



ence on the eye may be obtained from the diagram 
shown in Fig.3, showing a correspondence between 
convergence (parallax) and accommodation (visual 
range) and their allowable range. It is indicated in Fig.3 
that: the larger the difference between convergence 
(parallax) and accomnrKxiatlon (visual range] the great- 
er the degree of influence (fatigue measure) produced 
on the eye. As an example of the function f(p) for ex- 
pressing the influence measure In such case, a function 
Is formed as shown In the following equation (1) where 
an increase in ("visual range" - "parallax") results in a 
nonlinear increase in the influence measure. 

"Influence measure^ = a ("Visual range" - "Parallax")^ 
+ P ("Visual range" - "Parallax") + y (1) 

[0033] It is also known from the results of experiments 
conducted by the present inventors that: the larger the 
temporal change in parallax the greater the degree of 
influence; on the eye, Accordingly, a function as shown 
in the folbwing equatiQn:(2} may also be formed as an 
example of the function f(p) for expressing the influence 
measure. 



"Influence measure" = a ("Temporal change in parallax')^ 

+ |J (Temporal change In parallax") + y (2) 

[0034] it should be noted that a, p, y. In the above 
equations (1), (2) are coefficients and constants. 
[0035] Next, the value of influence measure f(p) ob- 
tained by the above function calculation is compared 
with an allowable limit value "a" of convergence (fusion 
image) (for example the solkJ lines through the black 
dots In Fig. 3) at which visual images may be recognized 
as a stereoscopic image (step S3). This allowable con- 
vergence limit value "a" may be regarded as an allowa- 
ble fatigue limit value, If the value of influence measure 
f(p) obtained by the functbn calculation based on par- 
allax Is greater than the allowable convergence limit val- 
ue "a", the system is switched to display a two-dimen- 
sbnal image (step S4). If the value of influence measure 
f(p) is smaller than the allowable convergence (imit val- 
ue "a": a time accumulation of the value of influence 
measure f (p) is calculated (step S5). The accumulated 
calculation value of the influence measure value f(p) ob- 
tained by the function calculation based on parallax is 
then compared with an allowable accumulated conver- 
gence limit value 'b' (step S6). This allowable accumu- 
lated convergence limit value "b* may be regarded as 
an allowable accumulated fatigue limit value and may 
be previously set by the maker of the apparatus, be in- 
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dividually adjusted and set by the user or be set by the 
user in accordance with the degree of fatigue when ac- 
tually used. 11 the allowable accumulation convergence 
Hmit value *b" has been exceeded, the system is 
switched to display a two-dimensional image (step 87). 
If the allowable accumulation convergence limit value 
"b" has not been exceeded, the three-dimensional (ster- 
eoscopic) visual image is displayed as It is (step S6) and 
the above operation is executed in repetition. 
[0036] According to this algorithm, the system is au- 
tomatically switched to a two-dimensional Image when 
a three-dimensional image exceeding the fusion innage 
limit has been received lor a short time period, and ft 
goes back to display a stlsreoscopic image upon retu rn- 
ing of a visual image of a lesser influence measure. If. 
then, fatigue has been accumulated and exceeded the 
limit value as a result of observing three-dimensional im- 
age for a long time period, the system is automatically 
switched to a two-dimensional image and, thereafter, a 
two-dimensional iniage is to be observed. 
[0037] A description will now be given by way o1 a 
block diagram In Fig.6 with respect to the constructfon 
of the parallax quantity detecting section and fati^e 
measure estimating section for executing the algorithm 
shown in Fig.4. The parallax quantity detecting section 
2 is constituted by a correlation calculating section 2-1 
at which a parallax signarp" is obtained by performing 
a correlation catcutatbn of the left and right video sig- 
nals. • ' 

[0038] The fatigue measure estinnating section 3 in- 
cludes a f unctbn calculating section 3-1 which receives 
the parallax signal "p" outputted from the parallax quan- 
tity detecting section 2 and provides a corresponding 
value of the functton 1(p) of influence measure (fatigue 
measure). An actual function calculation is not per- 
formed at the function calculating section 3-1 , but it in- 
cludes a table within a ROM so that, when a value of the 
parallax signal " p" has been Inputted, a value of f(p) 
matching the corresponding influence measure (fatigue 
measure) is read out. 

[0039] The fatigue measure estimating section 3 fur- 
ther includes: a first comparison section 3-2 for receiving 
the value of function 1(p) outputted from the function cal- 
culating section 3-1 and comparing it with the above de- 
scribed allowable convergence limit value "a"; and an 
accumulation calculating section 3-3 for also receiving 
the value of function 1(p) outputted from the function cal- 
culating section 3-1 and calculating the time accumula- 
tion of such value f(p). II the value f(p) from the function 
calculating section 3-1 is greaterthan the allowable con- 
vergence limit value "a" at the above described first 
comparison section 3-2, a signal lor temporarily switch- 
ing the stereoscopic image to a two-dimensional image 
is provided to the 3D/2D image switching section 4 and 
at the same time a stop signal for temporarily stopping 
the accumulation calculation is transmitted to the above 
described accumulation calculating section 3-3. The fa- 
tigue measure eslinnating section 3 furthemrtore in- 



cludes a second comparison section 3-4 for comparing 
the accumulated value outputted from the accumulation 
calculating section 3-3 with the above described allow- 
able accumulated convergence limit value "b". A signal 

s for switching the stereoscopic image to a twb-dimen- 
sbnal image Is continuously transmitted when the ac- 
cumulated value from the accumulation calculating sec- 
tion 3-3 has exceeded the allowable accumulated con- 
vergence limit value "b"; It should be noted that, since 

fo the value ot allowable accumulated convergence limit 
value "b" to be used at the above described second 
comparison section 3-4 may be set by using various 
methods as prevbusly described, meane tor setting the 
"b" values is provided correspondingly to such setting 

75 methods. 

[0040] A second embodiment will now be described. 
Fig 6 is a block diagram showing the second embodi- 
ment, where like components as in the first embodiment 
shown in Fig.1 are denoted by like numerals. In this em- 

20 bodimentv a parallax quantity changing section 6 is pro- 
vbed instead of the 3D/2D image switching section 4 in 
the first embodiment. It is constructed such that a re- 
strained^ stereoscopic video signal is provided with 
changing the parallax quantity (three-dimensionality) in 

25 stereoscopic video signal to a restrained parallax quan- 
tity, i.e., a target parallax quantity (restrained three-di- 
mensionality) at which for example fatigue is not caused 
even after an uninterrupted observation, based oh an 
output signal (parallax restraining signal) from a first 

30 comparison section, of the fatigue measure estimating 
section 3 of the same construction as that In the first 
embodiment shown In Flg.5, where a value of function 
f(p) corresponding to parallax is compared with the al- 
lowable convergence limit value "a" and based on an 

3s output Signal (parallax restraining signal) from a second 
comparison section where the accumulated calculation 
value of function 1(p) corresponding to parallax is com- 
pared with the allowable accumulated convergence limit 
value "b". This target parallax quantity corresponds to 

^0 the value at which accumulated fatigue due to an unin- 
terrupted obsewation is allowable, i.e., an allowable ac- 
cumulated fatigue value. 

[0041] A description will now be given by way of Figs. 
7 A to 7D with respect to an example of conversion Into 
a stereoscope video signal at a restrained parallax 
quantity. FlgsJA and 7B represent the lefl-eye image 
and right-eye image that are based on a stereoscopb 
video signal from the three-dimensional image repro- 
ducer. In order to restrain the parallax quantity (XL-XR) 

50 of these Images, the left-eye image shown In Flg.7A as 
a whole is shifted toward the left and the right-eye image 
shown In Fig.7B as a whole is shifted toward the right 
so as to change them as shown in Figs.7C and 7D. This 
shifting amount is the parallax restraining quantity As a 

ss result of this operation, the parallax quantity (XL'-XR') 
becomes smaller so that a stereoscopic image is ob- 
tained as of the parallax quantity (three-dimensionality) 
at which fatigue is not caused even alter an uninterrupt- 
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ed observation. 

[0042] In the above embodinrient, shifting of the !e1t 
and right images toward different directions from each 
other is shown as the technique for restraining parallax 
quantity. Other techniques for restraining the degree of 
three-dimensionality include a technique in which a 
compression of depth is effected. Particularly, in the 
technique fortransforming a two-dimensional image in- 
to a three-dimensional image as disclosed in Japanese 
patent application laid-open No.9-116928 which has 
previously been shown as a prior-art example, a relative 
depth of the object is inferred tor example from the con- 
trast in image and a threeTdimensional visual image is 
generated by imparting a distortion to the image corre- 
spondingly to such depth. When an inference is made 
by applying this technique as that a sphere is tocated In 
front of a triangular body in the two-dimensional image 
as shown in Flg.8A, a stereoscopic image is generated 
by imparting a distortion [corresponding to parallax (XL- 
XR)] so that the position of the sphere is different be- 
tween the left-eye image and the right-eye image as 
shown in Fig.8B. If the degree of three-dimensionality is 
to be restrained in such case, a visuai.image Is gener- 
ated as shown in Fig.SC in which the amount of distor- 
tion of the sphere is restrained. It Is thereby possible to 
obtain a stereoscopic image of which the degree of 
three-dimensionality is restrained by compressing the 
depth thereof. The amount. of distortion [parallax quan- 
tity (XL'-XR*)] at this time is desirablya distortion amount 
withln±D.6 diopter (D) of visual range (accommodation) 
as also can be seen from the diagram of correspond- 
ence In Flg.3. 

[0043] A third embodiment of will now be described. 
In the technique fortransforming a two-dimensional vis- 
ual image into a three-dimensional visual image as dis- 
closed in Japanese Patent Publication No.26 94235 
which has previously shown as a prior-art example, a 
three-dimensional image is generated by setting a par^ 
allax quantity (delay anriount) according to the extent of 
motion In the two-dimensional image. The third embod- 
iment is adapted to form a 2D/3D image switching signal 
at a fatigue measure estimating section on the basis of 
the parallax quantity set in such technique. 
[0044] Fig.9 Is a block diagram showing the third em- 
bodiment, including: 21, a two-dimensional image re- 
producer; 22, a parallax quantity determining section for 
determining the parallax quantity based on the extent of 
motion in the two-dimensional video signal from the two- 
dimensional image reproducer 21; and 23, a fatigue 
measure estimating section of the same construction as 
the fatigue measure estimating section in the first and 
second embodiments shown in Figs.1 and 6, receiving 
a parallax quantity from the parallax quantity determin- 
ing section 22 and transmitting a 2D/3D Image switching 
signal. What Is denoted by numeral 24 is a three-dimen- 
sional innage generating section for receiving the paral- 
lax quantity set at the parallax quantity determining sec- 
tion 22 and transforming a two-dimensional image into 



a three-dimensional image, and 25 is a visual image dis- 
play sectbn for displaying a three-dimensional image 
from the three-dimensional.image generating section 24 
or a two-dimensional image.. 
5 [0045] In the first and third embodiments shown In 
Figs. 1. and 9/ switching from a three-dimensional image 
to a two-dimensional image is made Instantly with an 
Interruption by a switching signal from the fatigue meas- 
ure estimating section. If a three-dimensbnal image is 

70 thus switched In an instant to a two-dimensional image, 
however, a fusion image cannot be formed due to the 
large temporal change in parallax. A modification of the 
embodiments shown in Figs.1 and 9 Is thus described 
below byway of Figs.lOA to 10D; where the system is 

'5 switched to a two-dimensional image while smoothly 
changing the degree of three-dimensionality, i.e., the - 
parallax quantity is continuously changed. In this modi- 
fication, the parallax (XL-XR) between the three-dimen- 
sional left and right images as shown in Fig. 1 0A is grad- 

20 ually reduced to those shown in Fig.lOBand 10C. Atwo- 
dimensional image is formed at the end by achieving 
XLsXR as shown in Fig.lOD. Switching of 3D/2D visual 
images is thereby possible without causing discomfort. 
[0046] A fourth embodiment will now be described. In 

25 this embodiment, instead of parallax quantity in a three- 
dimensional Image, motion vectors in the image are de- 
tected and the three-dimensional image is switched to 
a two-dimensional image on the basis of suchsmotion 
vectors. It is generally said that a visual image rnvolvnig. 

30 a vigorous motion produces a greater Influence on the 
obsen^en The present embod rnent is made to eliminate 
an occurrence of such phenomenon. Fig. II is a block di- 
agram showing the fourth embodiment, including: 31 . a 
three-dimensional image reproducer; 32. an image mo- 

36 tion detecting section for detecting motion vectors in a 
three-dimensional video signal outputtedfrom the three- 
dimensional image reproducer 31; 33, a fatigue meas- 
ure estinnating section for estimating the degree of fa- 
tigue based on the motion vectors detected at the Image 

40 motion delecting section 32; 34. a 3D/2D image switch- 
ing section for providing an output by switching between 
three-dimensional video signal and two-dimensional 
video signal according to a switching signal which is pro- 
vided on the basis of an estimation of fatigue measure; . 

45 and 35, a visual image display section for displaying a 
three-dimensional Image or a two-dimensional image 
provided from the image switching section 34. 
[0047J An example of detection of motfon vector at the 
image motion detecting section 32 will now be described 

so by way of Figs. 1 2A to 12C. In this example of detection, 
the background is being moved to the left as shown in 
Flgs.12A and 12B. Accordingly motion vectors as 
shown in Fig. 1 2C are detected and, for example, an av^. 
erage of these values is inputted to the fatigue measure 

55 estinnating section 33. 

[0048] A description will now be given by way of the 
flowchart in Fig. 13 with respect to an algorithm to be 
executed at the fatigue measure estimating section 33 
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in this embodiment. First, a motion vector "m" is delecl- 
ed from a stereoscopic video signal (step S11 ). A tunc- 
tion calculation tor; estimating the degree of fatigue Is 
then performed on the basis of the detected motion vec- 
tor "m" (step S12). -This function calculation is performed 
by considering the influence (fatigue) produced on the 
eye of the observer by the Image motion in the stereo- 
scopic image. For example, a value of function f(m) Is 
obtained on the basis of the extent and movement of the 
motion vector, the function being defined as that nonlin- 
early increasing in relation to the motion vector "m" such 
as in f(m) = ct»m2 + p«m + V^ The value f(m) obtained 
by the abovedescrlbedf unction calculation is then com- 
pared with an allowable limit value "a" (step Si 3). It the 
value f (m) obtained by the function calculation based on 
the motion vectors is greater than the allowable limit val- 
ue "a", the system is switched to display a two-dimen- 
sional-image (step SI 4): If the value ot function f(hf>) is 
smaller than the allowable limit value "a", a time accu- 
mulation is calculated of the function value f(m) (step 
S15]. The calculated value of accumulation of value f 
(m) obtained by the function catculatioh based oh the 
motion vectors is then compared wKh an allowable ac- 
cumulation limit value "b" (step SI 6). If the calculated 
value of accumulation of the function calculation value 
f(m) has exceeded the allowable accumulation limit val- 
ue "b". the system is switched to display a two-dimen- 
sional image (step SI 7). II it is smaller than the allowable 
accumulation limit value "b", the three-dimensional 
(sterebsoopic) image is displayed as It is (step SIB) and 
the above operation is-executed in repetition. 
[0049] A description will now be given by way of the 
block diagram of Fig. 1 4 with respect to the construction 
of the image motion detecting section and the fatigue 
measure estimating section for executing the algorithm 
shown in Fig. 13. The image motion detecting section 32 
is constituted by a motion amount calculating section 
32-1 for computing the motion vector "m" from a stere- 
oscopic video signal. The fatigue measure estimating 
section 33 includes a function calculating section 33-1 
for receiving motion vector *m* provided from the image 
motion detecting section 32 and butputting a corre- 
sponding function value f(m). Similarly to the first em- 
bodiment, an actual function calculation is not per- 
formed at the function calculating section 33-1 , but it in- 
cludes a table within a ROM so that, when a value of 
motion vector "m" has been inputted, a function value f 
(m) matching the corresponding influence measure (fa- 
tigue measure) is read out. 

[0050] The fatigue measure estimating section 33 fur- 
ther includes: a first comparison section 33-2 for receiv- 
ing the value of function t(m) outputted from the function 
calculating section 33-1 and comparing It with the above 
described allowable limit value "a"; and an accumulation 
calculating section 33-3 for also receiving the value of 
function f(m) outputtedfromthefunctioncalculatingsec- 
tion 33-1 and calculating the time accumulation of such 
value f (m). If the value f (m) from the function calculating 



section 33-1 is greater than the allowable limit value "a" 
at the above described first comparison section 33-2, a 
signal for temporarily switching the stereoscopic image 
to a two-dimensional irnage is provided to the stereo- 

s scopic/2D image swftching section 34 and at the same 
time a stop signal for temporarily stopping the accumu- 
latton calculation is transmitted to the above described 
accumulation calculating section 33-3. The fatigue 
measure estimating section 33 furthermore includes a 

10 second comparison section 33-4 for comparing the ac- 
cumulated value outputted from the accumulation cal- 
culating section 33-3 with the above described allowa- 
ble accumulated convergence limit value "b". A signal 
for continuously switching the steredscopic image to a 

75 two-dimensional image is transmitted when the accu- 
mulated value from the accumulation calculating section 
33-3 has exceeded the allowable accumulated conver- 
gence limit value "b". 

[0051] A fifth embodiment will now be described- In 
20 this embodiment, a parallax quantity (delay amount) is 
set in accordance with an extent df motion in a two-di- 
mensional image in a similar manner as the third em- 
bodiment, anda 3D/2D image switching signal is formed 
at the fatigue measure estimating section by using the 
25 extent of motion in the two-dimensional image detected 
in generating a three-dimensional image. ■ 
[0052] Fig. 1 5 is a block diagram showing the fifth em- 
bodiment, including: 41, a two-dimensional image re- 
producer; 42i a motion quantity detecting sectton for de- 
30 tecting motion vectors based on a two-dimensional vid- 
eo signal from the two-dimensional image reproducer 
41 ; 43, a fatigue measure estimating section of the same 
constructbn as the fatigue measure estimating section 
33 in the fourth embodiment shown in Fig. 11 for receiv- 
es ing motion vectors from the motion amount detecting 
section 42 and transmitting a 3D/2D image switching 
signal: What Is denoted by humeral 44 Is a three-dimen- 
slonai Image generating section for receiving the motion 
vectors detected at the motion quantity detecting sec- 
40 tion 42 and transforming a two-dimensional image into 
a three-dimensional image, and 45 is a visual image dis- 
play section for displaying the three-dimensional image 
from the three-dimensional image generating section 44 
or a two-dimensional image. 
45 [0053] In the above described fourth and fifth embod- 
iments, too, it is furthermore possible to restrain the 
three-dimensionality of three-dimensional image by an 
output signal from the fatigue measure estimating sec- 
tion instead of the switching from three-dimensional im- 
50 age to two-dimensional image. Furthernriore, It is also 
possible to cause a smooth change in parallax quantity 
as shown in FigsJ, 8 and 10. 
[0054] As has been described by way of the above 
embodiments, since, in accordance with the Inventkjn, 
55 the degree of influence produced on the obsen^er is es- 
timated from inputted video signal and the three-dimen- 
sionality of stereoscopic image is restrained or a stere- 
oscopic image is switched to a two-dimensional image 
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on the basis of such influence measure estimating quan- 
tity, ft is possible to achieve a visual image system in 
which a stereoscopic image can be suitably controlled 
so as not . to produce such effects as fatigue on the ob- 
server without any biological measurement.on the ob- s 
server. Further, sinc^, iaaccordance with the invention, - 
the degree of influence produced on the observer Is es- 
timated from Inputted video signal and display method 
of Image is controlled on the basis of such inttuence 
measure estimating quantity^ it is possible to achieve a io 
visual image system in which the display method otim-: 
age such as switching of stereoscopic image to two-di- 
mensional Image or restraining of paraRax quantity can 
be suitably controlled so as not to produce such effects 
as fatigue on the observer also without any biological 
measurement on the observer. 

Claims-' "■<■■>. 

: ■. - i- \ . . 20 

1. A visual image system conr^rising: ; 

Influence measure estimating means (S) for es- 
timating fnDm inputted video signal the degree 
of influence produced on an observer; , and ^5 
three-dimensionality controlling means: (4) for 
restraining the degree of three-dimensionality . . 
of stereoscopic Image to be presented tO;the 
observer based on,an Influence measure esti- 
mating quantity obtained at the Influence meas- 30 
ureestlrnatlng means. 

2. A visual Image system according to claim 1 , 
wherein said three-dimensionality controlling 
means (4) restrains the degree of three-dimension- 35 
ality of stereoscopic image to a value equal to or 
smaller than an allowable limit value of accumulat- 
ed influence produced on the observer 

3. A visual Image system according to claim 1 , 40 
wherein the restraining control for making a stere- 
oscopic Image into a stereoscopic image having a 
restrained three-dimensionality by said three-di- 
mensionality controlling means is effected in such 

a manner as to change the degree of. three-dimen- ^ 
sionality smoothly without an interruption. 

4. A visual image system according to claim 2, 
wherein the restraining control for making a stere- 
oscopic image into a stereoscopic image having a so 
restrained three-dimensionality by said three-di- 
mensionality controlling means is effected in such 

a manner as to change the degree of three-dimen- ' 
sionality smoothly without an interruption. 

55 

5. A visual image system comprising: 

influence measure estimating means for esti- 



mating from inputted video signal the degree of . 
influence produced on an observer; and 
:meians for regulating switching o1 stereoscopic, 
image to two-dimensional image based on an 
influence measure estimating quantity ob- 
tained at the influence measure estimating 
means; 

6. A visual image system accord irig to claim 6, 
wherein said means for regulating switching of im- 
ages regulates switching from a stereoscopic im- 
age to a two-dimensional Image while changsigthe 
degree of three^dlmenstonality of the stereoscopic 
image smoothly without an interruptran. 

7. A visual image system according to any of 
claims 1 to 6, wherein said Influence measure esti- 
mating means estimates the degree of influence 
produced on the observer by atinne lntegial thereof . 

8. A visual image system according to any of claims 1 
to S further comprising parallax quantity detecting 
means (2) for detecting parallax quantity in images 
from inputted'video signal, wherein said influence 
measure estimating means (3) estimates the de- 
gree of influence based on the parallax quantity de- 
tected by said parallax quantity detecting means 
(2). 

9. A visual Image system according lo claim 7 further 
comprising parallax quantity detecting means (2) 
for detecting parallax quantity in Images from Input- 
ted video signal, wherein said influence measure 
estifTBting nneans (3) estimates the degree of influ- 
ence based on the parallax quantity detected by 
said parallax quantity detecting means (2). 

1 0. A visual Image system according to any of claims 1 
to 6 further comprising shift amount detecting 

means for detecting a temporal shift amount in im- 
ages from inputted video signal, wherein said influ- 
ence measure estimating means estimates the de- 
gree of influence based on the temporal shift 
amount in Images detected by said shift amount de- 
tecting means. 

11. A visual image system accordrig to claim 7 further 
comprising shift amount detecting means for de- 
tecting a temporal shift amount in images from In- 
putted video signal, wherein said Influence meas- 
ure estimating means estimates the degree of influ- 
ence based on the temporal shift amount in images 
detected by said shift amount detecting means. 

12. A visual image system comprising: 

influence measure estimating means for esti- 
mating from inputted video signal the degree of 
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influence produced on an observer; and 
display controlling means for controlling dis- 
playing method of visual image to be presented 
to the observer based on an influence measure 
estimating quantity obtained at the influence s 
measure estimating means. 
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FIG. 12C 
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FIG. 13 
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